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Abstract 


Different types of evolutionary algorithms have been developed for constrained 
continuous optimization. We carry out a feature-based analysis of evolved con¬ 
strained continuous optimization instances to understand the characteristics of con¬ 
straints that make problems hard for evolutionary algorithm. In our study, we ex¬ 
amine how various sets of constraints can influence the behaviour of e-Constrained 
Differential Evolution. Investigating the evolved instances, we obtain knowledge 
of what type of constraints and their features make a problem difficult for the ex¬ 
amined algorithm. 

1 Introduction 

Constrained optimisation problems (COPs), specially non-linear ones, are very impor¬ 
tant and widespread in real world applications IT]. This has motivated introducing 
various algorithms to solve COPs. The focus of these algorithms is to handle the in¬ 
volved constraints. In order to deal with the constraints, various mechanisms have 
been adopted by evolutionary algorithms. These techniques include penalty function, 
decoder-based methods and special operators that separate the treatment of constraints 
and objective functions. For an overview of different types of methods we refer the 
reader to Mezura-Montes and Coello Coello 0. 

With the increasing number of evolutionary algorithms, it is hard to predict which 
algorithm performs better for a newly given COP. Various benchmark sets such as 
CECTO II and BBOBTO El have been proposed to evaluate the algorithm perfor¬ 
mances on continuous optimization problems. The aim of these benchmarks is to find 
out which algorithm is good on which classes of problems. For constrained continuous 
optimization problems, there has been an increasing interest to understanding problem 
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features from a theoretical perspective IHIIII- The feature-based analysis of of hard¬ 
ness for certain classes of algorithms is a relatively new research area. Such studies 
classify problems as hard or easy for a given algorithm based on the features of given 
instances. Initial studies in the context of continuous optimization have recently been 
carried out in uma. Having enough knowledge on problem properties that make it 
hard or easy, we may choose the most suited algorithm to solve it. To do this, two 
steps approach has been proposed by Mersmann et al. El. First, one has to extract the 
important features from a group of investigated problems. Second, in order to build 
a prediction model, it is necessary to analyse the performance of various algorithms 
on these features. Feature-based analysis has also been used to gain new insights in 
algorithm performance for discrete optimization problems El uni. 

In this paper, we carry out a feature-based analysis for constrained continuous 
optimisation and generate a variety of problem instances from easy to hard ones by 
evolving constraints. This ensures that the knowledge obtained by analysing problem 
features covers a wide range of problem instances that are of particular interest. Al¬ 
though what makes a problem hard to solve is not a standalone feature, it is assumed 
that constraints are certainly important in constrained problems. Evolving constraints 
is a new technique to generate hard and easy instances. So far, the influence of one lin¬ 
ear constraint has been studied 0. However, real world problems have more than one 
linear constraint (such as linear, quadratic and their combination). Hence, our study 
is to generate COP instances to investigate which features of the linear and quadratic 
constraints make the constrained problem hard to solve. To provide this knowledge, 
we need to use a common suitable evolutionary algorithm that handles the constraints. 
In this research, the £-constrained differential evolution with an archive and gradient- 
based mutation (eDEag) ca is used. The eDEag (winner of CEC 10 special session 
for constrained problems) is applied to generate hard and easy instances to analyse the 
impact of set of constraints on it. 

Our results provide evidence on the capability of constraints (linear, quadratic or 
their set of combination) features to classify problem instances to easy and hard ones. 
Eeature analysis by solving the generated instances with eDEag enables us to obtain 
the knowledge of influence of constraints on problem hardness which could later could 
be used to design a successful prediction model for algorithm selection. 

The rest of the paper is organised as follows. In Section 2, we introduce the con¬ 
strained optimisation problems. Then, we discuss eDEag algorithm that we use to 
solve the generated problem instances. Section 3 includes our approach to evolve and 
generate problem instances. Eurthermore, the constraint features are discussed. In Sec¬ 
tion 4, we carry out the analysis of the linear and quadratic constraint features. Einally, 
section 5 concludes with some remarks. 


2 Preliminaries 

2.1 Constrained continuous optimisation problems 

Constrained continuous optimisation problems are optimisation problems where a func¬ 
tion fix) on real-valued variables should be optimised with respect to a given set of 
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constraints. Constraints are usually given by a set of inequalities and/or equalities. 
Without loss of generality, we present our approach for minimization problems. 

Formally, we consider single-objective functions /; 5 —^ K, with 5 C K". The 
constraints impose a feasible subset F CS of the search space S and the goal is to find 
an element x G SOF that minimizes /. 

We consider problems of the following form: 

minimize f{x), x = (ri,... ,r„) G M" 

subject to giix)<0 yiG{l,...,q} (1) 

hj{x)=0 yj G{q+l,...,p} 

where x = (xi,X 2 ,...,x„) is an n dimensional vector and xG SFF. Also g,(x) and 
hj{x) are inequality and equality constraints respectively. Both inequality and equality 
constraints could be linear or nonlinear. To handle equality constraints, they are usually 
transformed into inequality constraints as \hj{x)\ < e, where e = lOe^^ (used in ||3l). 
Also, the feasible region F QS of the search space S is defined by 

U < Xi < M,-, f ^ i ^ n (2) 

where both /, and m,- denote lower and upper bounds for the /th variable and I <i<n 
respectively. 

2.2 eDEag algorithm 

One of the most prominent evolutionary algorithms for COPs is e-constrained differ¬ 
ential evolution with an archive and gradient-based mutation (eDEag). The algorithm 
is the winner of latest CEC competition for constrained constrained continuous prob¬ 
lems 0. The eDEag uses e-constrained method to transform algorithms for uncon¬ 
strained problems to constrained ones ca. It adopts e-level comparison instead of 
ordinary ones to order the possible solutions. In other words, the lexicographic order 
is performed in which constraint violation (0(x)) has more priority and proceeds the 
function value (/(x)). This means feasibility is more important. Let /i ,/2 and 0i,02 
are objective function values and constraint violation at xi,X 2 respectively. Hence, for 
all £ > 0, the £-level comparison of two candidates (/i,^i) and (/ 2 , 02 ) is defined as 
the follows: 


(/l:0l) <e (/2,02) 


(/l,0l) <£ (/2,02) 


/l 

< 

/2, 

if 

01,02 < e 

/l 

< 

fl, 

if 

01 = 02 

01 

< 

02, 

Otherwise 

fl 

< 

fl, 

if 

01,02 < e 

fl 

< 

fl. 

if 

01 = 02 

01 

< 

02, 

otherwise 


In order to improve the usability, efficiency and stability of the algorithm, an archive 
has been applied. Using it improves the diversity of individuals (see Algorithm[T]|. The 
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Algorithm 1 The e-constrained differential evolution with an archive and gradient- 
based mutation (eDEag) 

• Initializations: 

- M randomly selected individuals from search space S is archived in A. 

- Set £ level Using control level function 

- Population: Top A individuals are selected from archive. The Archive is ranked 
using £ level comparison 

• Termination condition is set to Maximum function evaluation number. 

• DE operation: Use DE/rand/l/exp to generate new child. Comparing is based on 
the £ level comparison 

• Gradient based mutation: If child is infeasible, it is changed by the gradient- 
based mutation with probability P. Go to step 3 and parent is considered as parent. 

• Update and control the £-level 

• Go to step 2 


offspring generation is adopted in such a way that if the child is not better than its 
parent, the parent generates another one (see ifTSll l. This leads to more stability to the 
algorithm. Eor a detailed presentation of the algorithm, we refer the reader to na. 

3 Evolving Constraints 

It is assumed that the role of constraints in problem difficulty is certainly important for 
constrained optimisation problem. Hence, it is necessary to analyse various effects that 
constraint can impose on a constrained optimisation problems. Evolving constraints is 
a novel methodology to generate hard and easy instances based on the performance of 
the problem solver (optimisation algorithm). 

3.1 Algorithm 

In order to analyse the effects of constraints, the variety of them needs to be studied 
over a fixed objective function. Eirst, constraint coefficients are randomly chosen to 
construct problem instances. Second, the generated constrained problem is solved by 
a solver algorithm (£DEag). Then, the required function evaluation number (EEN) 
to solve this instance is considered as the fitness value for evolving algorithm. This 
process is repeated until hard and easy instances of constraint problem are generated 
(see Eigure[T]). 

To generate hard and easy instances, we use the approach outlined in jSl. 

It uses fast and robust differential evolution (DE) proposed in ifTTIl (see Algorithm 
SID to evolve through the problem instances (by generating various constraint coef¬ 
ficients). It is necessary to note that the aim is to optimise (maximise/minimise) the 
EEN that is required by a solver to solve the generated problem. Also, to solve this 
generated problem instance and find the required EEN we use £DEg as a solver. The 
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Figure 1: Evolving constraints process 


termination condition of this algorithm (evolver) is set to reaching FENmax number of 
function evaluations or finding a solution close enough to the feasible optimum solution 
as follows: 


\f{Xoptimum) fixbest)\ ^ ^ (3) 

This process generates harder and easier problem instances until it reaches the cer¬ 
tain number of generation for the DE algorithm (evolver). Once two distinct sets of 
easy and hard instances are ready, we start analysing various features of the constraints 
for these two categories. This could give us the knowledge to understand which fea¬ 
tures of constraints have more contribution to problem difficulty. 

3.2 Evolving a set of inequality constraints 

We focus on analysing the effects of constraints (linear, quadratic and their combina¬ 
tion) on the problem and algorithm difficulty. We will extract features of constraints 
and analyse their effect on constrained problem difficulty. The experimented con¬ 
straints are linear and quadratic as the form of: 


linear constraint g{x) = b ~\- a\x\ + ... a„Xn (4) 

quadratic constraint g(x) = b + a\x\ + a 2 Xi ... -f a 2 n-+ o.in^n (5) 

or combination of them. We also consider various numbers of these constraints in 
this study. Here, xi,X 2 ■ ■ ■ ,x„ are the variables from Equation [T] and ai,a 2 ■ ■ ■ , 0 ,, are 
coefficients within the lower and upper bounds (lc,Uc). In our research, we construct 
constrained problems where the optimum of the experimented unconstrained problem 
is feasible. We use quadratic function as the form of Equation (univariate) since 
it is more popular in recent constrained problem benchmarks. Also, the influence of 
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Algorithm 2 Differential evolution (DE) algorithm 

• inputs: Problem and Popsi^e, Crossoverrate ^weightingfactor, outputs: Sbest 

• Population ^ InitializePop 
EvaluatePopulation(population) 

Sbest ^ GetBestSolution(Population) 

• Repeat 

• NewPopulation ^ (j) 

• For i starts at 1, i< Popstze-^, increment i 

• Si ^ Newsample 

• If Cost(5j)<Cost(P,) 

• NewPopulation ^ Si 

• else 

• NewPopulation 4- E 

• Endif 

• Endfor 

• Population 4— NewPopulation 

• EvaluatePopulation(population) 

• Sbest ^ GetBestSolution(Population) 

• Until (stop condition) 


each ;ii:„s can be analysed independently (exponent 2). The optimum of these problems 
is X* = (0,... ,0) and we ensure that this point is feasible by requiring b <0, when 
evolving the constraints. 

3.3 Constraints Features 

In this paper, we study a set of statistic based features that leads to generating hard and 
easy problem instances. These features are discussed as follows: 


• Constraint Coefficients Relationship: It is likely that the statistics such as stan¬ 
dard deviation, population standard deviation and variance of the constraints co¬ 
efficients can represent the constraints influences to problem difficulty. These 
constraint coefficients are {b,ai,a 2 , ■ ■ • ,a„) in Equation]^ and 

• Shortest Distance: This feature is related to the shortest distance between the 
objective function optimum and constraint. In this paper, the shortest distance 
to the known optimum from each constraint and their relations to each other is 
discussed. To And the shortest distance of optimum point {xi,X 2 , ■ ■ ■ ,Xn) to the 
linear constraint hyperplane (aixi + 02 x 2 + ... OnXn + b — 0) we use Equation]^ 
also, for quadratic constraint hyperplane {a\x\ + a 2 X \... -f a{ 2 n-\)^'i + <^ 2 nXn + 
b = 0) we need to find the minimum of Equation]^ 
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Algorithm 3 Newsample function in Algorithm]^ 

• inputs: Pq, population, NP, F, CR, outputs: S 

• Repeat 

• Pi ^ RandomMember(population) 

• Untill Pi 7 ^ Pi 

• Repeat 

• Pi RandomMember(population) 

• Untill P 2 7 ^ Po V P 2 7 ^ Pi 

• Repeat 

• P 3 -i— RandomMember(population) 

• Untill P 3 7 ^ Po V P 3 7 ^ Pi P 3 7 ^ Pi 

• outpoint ^ RandomMember(population) 

• Sample ^ 0 

• For i starts a 1 to NP 

• If i = outpoint A Rand() < CR 

• Si ^ P 3 , + F*(Pi,-P 2 ,) 

• Else 

• Si ■<r- Pq. 

• Endif 

• Endfor 

• Return S 


di_ 


aiXQi + a2X02 + ... a„xon + b 
\Jai^ -h a2^ + • • • -f a^^^ 


(6) 


dl_ = ^ (xi - Xoi Y + (X2 - XQ2Y H- '^{Xn- XQnY ( 7 ) 

where di_ in Equation]^ is the distance from a point to a quadratic hyperplane. 
Minimizing the distance squared is equivalent to minimizing the distance 
t/x. 


• Angle: This feature describes the angle of the constraints hyperplanes to each 
other. It is assumed that the angle between the constraints can influence problem 
difficulty. To calculate the angle between two linear hyperplanes, we need to find 
their normal vectors and angle between them using the following equation: 


9 = arccos 


«! • 

I«l||«2| 


( 8 ) 


where ni,n 2 are normal vectors for two hyperplanes. Also, the angle between 
two quadratic constraints is the angle between two tangent hyperplanes of their 
intersection. Then, the angle between these tangent hyperplanes can be calcu¬ 
lated by Equation!^ 
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• Number of Constraints: Number of constraints plays an important role in 
problem difficulty. In this research, number of constraints and their effects to 
make easy and hard problem instances is analysed. 

• Optimum-local Feasibility Ratio: Although the global feasibility ratio is im¬ 
portant to find the initial feasible point, it should not affect the convergence rate 
during solving the problem. So, in this research, he feasibility ratio of gener¬ 
ated COP is calculated by choosing 10e6 random points within the vicinity of 
the optimum in search space and the ratio of feasible points to all chosen ones 
is reported. In our experiment, the vicinity of optimum is equivalent to 1/10 of 
boundaries from optimum for each dimension. 

4 Experimental Analysis 

We now analyse the features of constraints (linear, quadratic and their combination) for 
easy and hard instances. We generate these instances for (eDEg) algorithm using well 
known objective functions. In our experiments, we generate two sets of hard and easy 
problem instances. Due to stochastic nature of evolutionary algorithms, for each num¬ 
ber of constraints we perform 30 independent runs for evolving easy and hard instances. 
We set the evolving algorithm (DE) generation number to 5000 for obtaining the proper 
easy and hard instances. The other parameters of evolving algorithm are set to popu¬ 
lation size = 40, crossover rate = 0.5, scaling factor = 0.9 and FENmax is 300,000. 
Values for these parameters have been obtained by optimising the performance of the 
evolving algorithm in order to achieve the more easier and harder problem instances. 
Eor (eDEg) algorithm, its best parameters are chosen based on 113. The (eDEg) al¬ 
gorithm parameters are considered as: generation number = 1500, population size = 
40, crossover rate = 0.5, scaling factor = 0.9. Also, the parameters for e-constraint 
method are set to control generation (Tc) = 1000, initial e level {q) = 0.9, archive size 
= lOOn in is dimension number), gradient-based mutation rate {Pg) = 0.2 and number 
of repeating the mutation (Rg) = 3. 

4.1 Analysis for Linear Constraints 

In order to focus only on constraints, we carry out our experiments on various well- 
known objective functions. These functions are considered as: Sphere (bowl shaped), 
Ackley (many local optima), Rosenbrock (valley shaped) and Schaffer (many local 
minima) (see 111). The linear constraint is as the form of Equation|^with dimension (n) 
as 30 and all coefficients (a„)s and fe are within the range of [—5,5]. Also, number of 
constraints is considered as 1 to 5. To discuss and study some features such as shortest 
distance to optimum, we assume that zero is optimum (all bs should be negative). We 
used (eDEg) algorithm as solver to generate more easy and hard instances. 

To illustrate our investigation, we plot a 2 dimension Sphere function with 2 to 

5 linear constraints in Eigure It is obvious that the first row (easy) instances have 
higher feasibility ratio than the second row (hard). 
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Figure 2: Easy (first row) and hard (second row) instances for 1 to 5 number of linear 

constraints using eDEg (2 dimension). The dark blue hyperplane is the feasible 

solution 

In the following we will present our findings based on various features for linear 
constraints (for each dimension). 

Eigure shows some evidence about linear constraints coefficients relationship 
such as standard deviation. It is obvious that there is a systematic relationship between 
the standard deviation of linear constraint coefficients and problem difficulty. The box 
plot (see Eigure]^ represents the results for easy and hard instances using Sphere, Ack¬ 
ley, Rosenbrock and Schaffer objective function for (eDEg) algorithm (solver). As it 
is observed, the standard deviation for coefficients in each constraint (1 to 5) for easy 
instances are lower than hard ones. Both these coefficient values can be a significant 
role to make a constrained problem harder or easier to solve. Also, interestingly, all 
different objective functions follow the same pattern. 

Eigure [^represents variation of shortest distance to optimum feature for easy and 
hard instances using (eDEg) algorithm. The lower value means the higher distance 
from optimum. This means, the linear hyperplanes in easy instances are further from 
optimum. Based on results, there is a strong relationship between problem hardness 
and shortest distance of constraint hyperplanes to optimum. In other word, this feature 
is contributing to problem difficulty. As expected, all objective functions follow the 
same systematic relationship between their feature and problem difficulty. This means, 
this feature can be used as a proper source of knowledge for predicting problem diffi¬ 
culty. 

The angle between linear constraint hyperplanes feature shows relationship be¬ 
tween the angle and problem difficulty (see Tablel^l. As it is observed in this table, the 
angle between constraints in easier instances are less than higher ones. So, this feature 
is contributing in problem difficulty. 
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Figure 3: Easy (first row) and hard (second row) instances for 1 to 5 number of 
quadratic constraints using eDEg (2 dimension). The dark blue hyperplane is the 

feasible solution 


Table 1: The angle feature for Sphere objective function 



Cons 1,2 

Cons 1,3 

Cons 1,4 

Cons 1,5 

Cons 2,3 

Cons 2,4 

Cons 2,5 

Cons 3,4 

Cons 3,5 

Cons 4,5 

DE Easy 

15 

17 

25 

21 

32 

27 

41 

47 

45 

43 

DE Hard 

45 

51 

63 

59 

62 

73 

76 

69 

79 

86 
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Table 2: The FEN for linear consti'aints 


Table 3: The FEN for quadratic constraints 


Constraint - 

Easy 

Hard 

Function 

Instance 

Instance 

1 c Sphere 

25.6K 

91.2K 

2 c Sphere 

28.9K 

93.4K 

3 c Sphere 

32.4K 

98.3K 

4 c Sphere 

34.2K 

104.2K 

5 c Sphere 

35.5K 

123.2K 

1 c Ackley 

65.2K 

232. IK 

2 c Ackley 

69.3K 

243.7K 

3 c Ackley 

74.2K 

265.4K 

4 c Ackley 

86.4K 

271.3K 

5 c Ackley 

92.3K 

277.2K 

1 c Rosenbrock 

32.8K 

145.2K 

2 c Rosenbrock 

35.9K 

153.3K 

3 c Rosenbrock 

34.5K 

I67.9K 

4 c Rosenbrock 

42.2K 

172.4K 

5 c Rosenbrock 

48.3K 

176.8K 

1 c Schaffer 

84.8K 

247. IK 

2 c Schaffer 

87.9K 

259. IK 

3 c Schaffer 

93.5K 

280.3K 

4 c Schaffer 

103.2K 

293.8K 

5 c Schaffer 

112.4K 

297.4K 


Constraint - 

Easy 

Hard 

Function 

Instance 

Instance 

1 c Sphere 

24.2K 

129.3K 

2 c Sphere 

25.3K 

132.6K 

3 c Sphere 

27.9K 

136.2K 

4 c Sphere 

34.1K 

141.2K 

5 c Sphere 

38.7K 

149.3K 

I c Ackley 

68.4K 

228.3 

2 c Ackley 

72.9K 

232.5K 

3 c Ackley 

84.5K 

239.6K 

4 c Ackley 

95.3K 

247.9K 

5 c Ackley 

98.1K 

251.9K 

1 c Rosenbrock 

3I.4K 

173.2K 

2 c Rosenbrock 

32.45K 

182.3K 

3 c Rosenbrock 

42.5K 

190.6K 

4 c Rosenbrock 

52.7K 

192.8K 

5 c Rosenbrock 

71.IK 

213.4K 

1 c Schaffer 

91.3K 

278.9K 

2 c Schaffer 

94.9K 

283.IK 

3 c Schaffer 

I03.7K 

289.3K 

4 c Schaffer 

II4.IK 

296. IK 

5 c Schaffer 

123.4 

300k 


Table [^explains the variation of number of constraints feature group. It is shown 
that the problem difficulty (required FEN for easy and hard instances) has a strong 
systematic relationship with number of constraints for the experimented algorithm. 

To calculate the optimum-local feasibility ratio, lOe® points are generated within 
the vicinity of optimum (zero in our problems). Later, the ratio of feasible points to 
all generated points are investigated for easy and hard instances. Results point out that 
increasing number of linear constraints, decreases the feasibility ratio for experimented 
algorithms (see Table|^. 

In summary the variation of feature values over the problem difficulty is more 
prominent in some of them than the other groups of features. Features such as, co¬ 
efficients standard deviation, shortest distance, angle between constraints, number of 
constraints and feasibility ratio exhibit a relationship to problem hardness. This rela¬ 
tionship is stronger for some features. 

4.2 Analysis for Quadratic Constraints 

In this section, we carry out our experiments on quadratic constraints. We use various 
objective functions, dimension and coefficient range similar to linear analysis. In the 
following the group of features are studied for easy and hard instances using quadratic 
constraints. 
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Table 4: Optimum-local feasibility ratio of search space near the optimum for 1,2,3,4 

and 5 linear constraint 



DE Easy 

DE Hard 

1 cons 

42% 

7% 

2 cons 

32% 

6 % 

3 cons 

22 % 

4% 

4 cons 

17% 

3% 

5 cons 

11 % 

2 % 


Observing the Figure we can identify the relationship of quadratic coefficients 
and their ability to make problem hard or easy. Based on the experiments, quadratic co¬ 
efficients has the ability to make problems hard or easier for algorithms. In other words, 
in each constraint, the quadratic coefficients (within the quadratic constraint) are more 
contributing to problem difficulty than linear coefficients (see Equation]^. Figure 
shows the standard deviation of quadratic coefficients for easy and hard COPs. As 
shown, the standard deviation of quadratic coefficient in 1 to 5 constraints in easy in¬ 
stances are less than harder one. In contrast to quadratic coefficients, our experiments 
show there is no systematic relationship between the linear coefficient in quadratic 
constraints and problem hardness. In other words, quadratic coefficients are more con¬ 
tributing than linear ones in the same quadratic constraint. 

Box plots shown in Figure represent the shortest distance of a quadratic con¬ 
straint hyperplanes to optimum. As it is observed, harder instances have constraint 
hyperplanes closer to optimum than easier ones. The lower values in these box plots 
means closer to optimum. Calculating the angles between constraints do not follow 
any systematic pattern and there is no relationship between angle feature and problem 
difficulty for quadratic constraints. We also study the number of quadratic constraints 
feature. As it is shown in Table number of quadratic constraints is contributing 
to problem difficulty. It is obvious that increasing number of quadratic constraints 
makes a problem harder to solve (increases FEN). As observed in Table investi¬ 
gations on feasibility ratio show that increasing number of constraint decreases the 
problem optimum-local feasibility ratio for easy and hard instances respectively. As it 
is observed, some group of features are more contributing to problem difficulty than the 
others. It is shown that angle feature does not follow any systematic relationship with 
problem hardness for experimented algorithm for quadratic constraints. On the other 
hand standard deviation, feasibility ratio and number of constraints are more contribut¬ 
ing for eDEag. 

4.3 Analysis for Combined Constraints 

In this section, we consider the combination of linear and quadratic constraints. The 
generated COPs have different numbers of linear and quadratic constraints (5 con¬ 
straints). The obtained results show the higher effectiveness of quadratic constraints. 
In other words, these constraints are more contributing to problem difficulty than linear 
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Table 5: Optimum-local feasibility ratio of search space near the optimum for 1,2,3,4 

and 5 quadratic constraint 



DE Easy 

DE Hard 

1 cons 

36% 

11 % 

2 cons 

27% 

7% 

3 cons 

12 % 

4% 

4 cons 

11 % 

3% 

5 cons 

8 % 

2 % 


Table 6: The FEN for combined constraints using Sphere objective function 



DE Easy 

DE Hard 

1 Lin 4 Quad 

22.4K 

97.5K 

2 Lin 3 Quad 

17.5K 

95.IK 

3 Lin 2 Quad 

16.5K 

94.2K 

4 Lin 1 Quad 

14.1K 

91.4K 


ones. By analysing the various number of constraints (See Table we can conclude 
that required FEN for sets of constraints with more quadratic ones is higher than sets 
with more linear constraints. This relationship holds the pattern for both easy and hard 
instances. 

In summary it is observed that the variation of linear and quadratic constraint co¬ 
efficients over the problem difficulty is more contributing for some group of features. 
Considering quadratic constraints only, it is obvious that some features such as angle 
do not provide useful knowledge for problem difficulty. In general, this experiments 
point out the relationship of the various constraint features of easy and hard instances 
with the problem difficulty while moving from easy to hard ones. This improves the 
understanding of the constraint structures and their ability to make a problem hard or 
easy for a specific group of evolutionary algorithms. 


Conclusions 

In this paper, we performed a feature-based analysis on the impact of sets of constraints 
(linear, quadratic and their combination) on performance of well-known evolutionary 
algorithm (eDEag). Various features of constraints for easy and hard instances have 
been analysed to understand which features contribute more to problem difficulty. The 
sets of constraints have been evolved using an evolutionary algorithm to generate hard 
and easy problem instances for eDEag. Furthermore, the relationship of the features 
with the problem difficulty have been examined while moving from easy to hard in¬ 
stances. Later on, these results can be used to design an algorithm prediction model. 
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Figure 4; Box plot for standard deviation of coefficients in linear (A,C,E,G) and 
quadratic (B,D,F,H) constraints for Sphere (A,B), Ackley (C,D), Rosenbrok (E,F) and 
Schaffer (G,H). Each sub figure includes 2 sets of hard (H) and Easy (E) instances 
with 1 to 5 constraints using algorithms (a/b/c denotes a: constraint number, b: 
easy/hard instances and c:algorithm). 
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Figure 5: Box plot for the shortest distance to optimum of linear (A,C,E,G) and 
quadratic (B,D,F,H) constraints for Sphere (A,B), Ackley (C,D), Rosenbrok (E,F) and 
Schaffer (G,H). Each sub figure includes 2 sets of hard (H) and Easy (E) instances 
with 1 to 5 constraints using DE algorithm (a/b/c denotes a: constraint number, b; 
easy/hard instances and c:algorithm). 
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